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THIS REPORT OF THE ILLINOIS STATE-WIDE CURRICULUM STUDY 
CENTER IN THE PREPARATION OF SECONDARY SCHOOL ENGLISH 
TEACHERS (ISCPET) DESCRIBES AN INSERVICE TRAINING COURSE FOR 
42 TEACHERS IN 1965-66 WHICH TESTED THE HYPOTHESIS THAT SUCH 
A COURSE COULD IMPROVE TEACHERS' ABILITIES TO THINK 
CRITICALLY. GUILFORD'S INTELLECT STRUCTURE MODEL WAS USED TO 
STUDY THE OPERATIONS OF THE MIND AND TO PLAN INSTRUCTION. THE 
EXPERIMENT WAS DESIGNED TO DEMONSTRATE THAT CRITICAL THINKING 
DEMANDS VARIED, SPECIFIC, SEPARABLE, AND MEASURABLE 
ABILITIES. THE CHARACTERISTIC FEATURE WAS ALERTING TEACHERS 
TO THE IMPORTANCE OF TEACHING FOR THINKING, INFORMING THEM 
ABOUT THE OPERATIONS OF THE MIND, AND APPLYING SUCH 
INFORMATION TO CLASSROOM INSTRUCTION. VARIOUS LEARNING 
ACTIVITIES CAN BE BASED ON THE ASSUMPTIONS (1) THAT THINKING 
IS A PROCESS, NOT A RESULT, <2> THAT A STIMULATING SCHOOL 
ATMOSPHERE IS A NECESSARY FACTOR FOR THE VARIOUS SKILLS TO BE 
DEVELOPED, AND <3) THAT THE SKILLS OF THINKING MUST BE THE 
TEACHER'S IMMEDIATE AND CONTINUOUS OBJECTIVE. THE POSSIBILITY 
OF SETTING UP CRITICAL THINKING AS AN INTEGRATING PRINCIPLE 
OF INSTRUCTION WAS CONSIDERED. TESTS USED WERE THE 
"WATSON-GLASER CRITICAL THINKING APPRAISAL" AND AN ADAPTATION 
OF THE "DRESSEL-MAYHEW TEST." POSITIVE BUT STATISTICALLY 
NONSIGNIFICANT GAINS WERE MADE IN BOTH. (THIS DOCUMENT IS 
ALSO AVAILABLE (LIMITED SUPPLY, FREE) FROM ISCPET, 1210 WEST 
CALIFORNIA, UNIV. OF ILL., URBANA, ILL. 61801.) SEE ALSO TE 
OOO 469. (AUTHOR) 
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I . INTRODUCTION 



A. Problem « Background » and 'Review of Related Research 

The need for in-service training for elementary and secondary school 
teachers has always been recognized. This is especially imperative 
today for proper pedagogical adaptation in light of the complexities 
of modern living. Accounts of vast research carried on through private 
and public enterprise likewise suggest that teacher training needs up~ 
dating. Teachers who were prepared a decade or more ago are in special 
need of in-service training. New developments in content areas and in 
the psychology of learning stimulate and challenge educators to improve 
their present offerings for experienced teachers. A major area needing 
attention today is that of developing students* abilities to think 
critically. 

The individual teacher should be convinced that it is his inescapable 
responsibility to educate his students for citizenship in a democracy. 

He should have in mind the type of individual the school hopes to 
produce and the method by which that goal can be reached . In a demo” 
cracy where the greatest good of all is best subserved by the highest 
development of each, where truth is our best weapon in the fight for 
freedom, and where truth, wisdom, civic responsibility, and the good 
life must be considered important if democracy is to survive, educa- 
tion must be related in a positive manner to those priorities of value. 
Intelligence must be a guide for behavior. 

Anyone interested in the American way of life recognizes that such 
skills as Interpreting data accurately, using logical arguments, 
drawing sound generalizations, recognizing fallacies and sophistries 
in the arguments of others, and applying acceptable principles to new 
situations are valid objectives of a curriculum. 

Learning how to think critically is a difficult process and it is 
difficult for teachers to guide students in the rigorous use of the 
higher mental processes. The difficulty of training students to think 
critically oftentimes stems from teachers* lack of understanding of the 
nature of reasoning and of their failure to use the possibilities that 
a classroom situation presents. Teachers often consider other objectives 
more important. Their emphasis upon an accumulation of factual informa- 
tion results in complaints about an already overcrowded curriculum and 
in the accompanying fears about the underemphasis of certain areas. 

Some teachers still labor under the misconception that thinking proceeds 
automatically out of knowledge. 

Unnaturalness of the school situation and its limited materials and 
activities often add to the difficulty by helping to make students* 
activities stereotyped rather than thought provoking. Another obstacle, 
and a very serious one, is that curriculum content is usually organized 
for purposes other than facilitation of critical thinking. 
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If the approach is a factual ones there is less attention given to 
critical thinking than in a problematic approach. Other obstacles can 
come in the form of unsympathetic superiors and in the fallacy of 
attaching importance to the mental processes involved in arriving at 
answers according to a set pattern Involving specific steps carried 
out in an invariable order. Teachers can never hope to give children 
all the answers they x^ill ever need in life; this kaleidoscopic world 
requires constant readaptatibn to nevr and different problems. This 
places obligations upon the teacher. 

The present study emerged as a response in attempting to meet that 
obligation. It reflects, directly or indirectly, the contributions of 
many scholars. One of the most thorough attempts to improve critical 
thinking was Edward M. Glaser’s study in which high school students 

were taught some of the essentials of' logic and the psychology of thinking 
with practice in the recognition of error and critical evaluation of 
newspaper crtlcles. David H. Russell in the 1960 edition of the Encyclo - 
pedia of Educational Research ^^^^ makes the comment that the breadth of 
the topic and the variety of investigations Indicate the growing impor- 
tance of the problem. Current interest in the topic is also reflected 
by the larger number of recent publications in the area. However, the 
volume of research in critical thinking is not commensurate with the ^ 
frequency of the use of the term in statements of educational objectives 
and other curriculum materials. According to research reported by 
Russell, critical thinking in most curriculum areas can be taught through 
suitable classroom practices. In a culture where there is some stress 
on conformity, critical thinking may be one of the most important abil- 
ities taught in school. Children can learn to be critical of what they 
read or hear and be stimulated to various creative endeavors if a com- 
petent teacher has such definite objectives in mind and works with the 
group toward attaining them not only in some special lessons but during 
many parts of the day’s work. 

Since 1960 serious attention has been given to cognitive abilities. 

Mary Jane Aschner and Charles E. Bish edited Productive Thinking in 
Education (^) . which is the result of twb Conferences on Productive 
Thinking, a part of the six-year program of the National Education 
Association Project on the Academically Talented Student. In these 
conferences psychologists met with educators to share new theories and 
findings and to translate them into suggestions for practical educational 
prodecures. One conclusion drawn from the papers in the book is that 
the new curriculum movements are bound together with the new concepts 
of thinking abilities. The papers reveal a concern that the student 
should be an active learner, developing his own thinking abilities, as 
well as absorbing necessary content information. 

Hilda Taba gives a summary of the more recent studies in thinking (^9) , 
describing the work of Peel (1960) , Smith (1960) , Guilford (1960) , 
Vygotsky (1962), Bruner (1963), and Gallagher (1965). 
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The knowledge gained from research relative to the development of 
cognitive abilities is being made available to the practitioner by means 
of such books as I mproving Teaching and Classroom Questions z T'Jhat 
Kinds? (^6), Unless the results of such studies are applied in teacher 
education programs, the benefits of these studies will remain solely 
theoretical . 

B. Objectives and Hypothesis 

An opportunity arose during the second semester (February-IIay 1966) at 
Loyola University in Chicago to work with a group of 42 experienced 
teachers currently teaching in elementary and secondary schools of 
Chicago and vicinity. These teachers were concerned about meeting certi- 
fication requirements in professional education. Loyola University was 
cooperative in allowing the establishment of the course and the experi- 
mental procedures described here. 

While this study was being conducted with experienced teachers, another 
investigation was being carried on with prospective teachers of high 
school English enrolled in a methods course. That study is described 
in a report similar to this one entitled Aa Experimental Study of. the 
Development of Critical Thinking Skills of High School English Teachers 
Enrolled in a Methods Course The aims of the two studies were 
similar. Modifications xi/ere made in view of the facts that in the 
study described in this report all subjects were experienced teachers, 
most of whom were elementary school teachers. The high school teachers 
of this group Included other than English teachers. 

Both studies were concerned basically with alerting teachers to some of 
the new trends in educational psychology relating to language and 
learning and tested the hypothesis that a conscious effort to familiar- 
ize teachers with some of the skills needed for critical thinking as 
applied to elementary or secondary school curricula can result in the 
improvement of teachers* abilities to think critically. 

The course attempted to study the necessity, the possibility, and the 
methodology of critical thinking and other Intellectual operations as 
they can operate in daily instruction in the language arts within the 
context of a usual curriculum. Attention was given to the following 
skills: the ability to make deductions, to make interpretations, to 

evaluate arguments, and to recognize Inferences, assumptions, bias 
factors, common fallacies, and propaganda techniques. The assumption 
basic to this rationale is that the skills needed for productive 
thinking and evaluation, as defined by Guilford and others, should 
operate within a teacher- training program. 

II. METHOD 

A. The Testing Program 

The WATSON-GLASER CRITICAL THINKING APPRAISAL^^®^ was administered to 
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the 42 students at the beginning and at the end of the semester, forms 
YM and ZM, respectively^. The DRESSEL-MAYHEW TEST (9) ^as also administered 
at the beginning and at the end of the semester. Since only one form is 
available, the same form was used for pre- and post-testing. The sta- 
tistical analysis of the data was done by Dr. Samuel T. Mayo, Director 
of the Educational Research Center of Loyola University x^rho is also the 
Director of the Measurement and Competency Project of the U.S. Office of 
Education which project trains researchers in educational measurement. 

B. The Course 

The course was taught by the investigator and comprised, but was not 
limited to, the following major areas: 

1. Excellence In Education 

This topic was studied with the help of the following film- 
strips and records obtained from the National Education 
Association: AIM FOR EXCELLENCE 

EMERGING EDUCATIONAL OPPORTUNITIES FOR ALL 
THE 1965 I-JHITE HOUSE CONFERENCE ON EDUCATION 

2. Comprehensiveness of Education 

The filmstrip and record OVERVIEW OF ETS from the Educational 
Testing Service was used to explain the relationship of research 
and testing to the objectives of education. 

Z, The Human Mind in Reference to Language and Critical Thinking 

a. The three-dimensional approach to the study of the intel- 
lect and its contents (verbal and nonverbal), its products, 
and its operations (cognition, memory, convergent thinking, 
divergent thinking, and evaluation) of J. P. Guilford (ll) . 

(See A-1, p.l4.) 

b. A study of the likenesses and differences of language and 
thought as explained by David H. Russell 

c. Reading of William Shanner’s A Guide to Logical Thinking ^^^^ * 

d. Study of some of the specific skills needed for critical 

thinking: Inference, recognition of assumptions, deduction, 

interpretation, and evaluation of arguments j finding the main 
point in a selection, information supporting the author’s 
position, ideas and beliefs whirth the author takes for granted; 
Identifying stereotypes, biased statements, and unverlflable 
data* and classifying kinds of terms and the forms of discourse. 

4. The teacher In Reference to Language and Critical Thinking 
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a. A study of the art of questioning with the following 

Bel-Mort filmstrips : THE LOGICAL DIflENSIONS OF TEACHING 

EXPLAINING 
ASKING QUESTIONS . 

b. Interaction of the contents of an English program with the 
activities of the learner and the effect of this interaction 
upon the learner's mind. (See hr2, p.l5.) 

The content of English is the study of language, composition, 
and literature. The student acquires new skills in four 
activities commonly referred to by rhetoricians: reading, 

writing, speaking, listening. These activities within the 
context of an English program form occasions for the operation 
of varied mental processes. 

c. Sensitivity to teacher behavior, to student behavior, and 
to intellectual behavior in "Making Changes in How Teachers 
Teach” as explained by Daniel A. Lindley (an address deli- 
vered to the Conference of Supervisors and Consaitants , Na- 
tional Council of Teachers of English, November 1965). (See 
A-3, p.l6.) 

d. Principles of teacher-student interaction: 

(1) Teachers are their own best agents of change. 

(2) Teachers are not very insightful about what they do when 
they teach* the more they find out about what they 
actually do, the more insightful they can become. 

(3) T-Jhat the teacher knows and what he teaches are Important; 
what he is and how he teaches are also important. 

(4) Once he learns what sort of questions there are and why 
he can use them, he can make a conscious effort to ask 
questions that encourage productive thinking. 

5. Study of the theoretical and practical basis of teaching for 
critical thinking, especially by means of: 

a. Definition, use of language, fallacies in thinking as 
explained in Max Black's Critical Thinking . 

b. Forms and types of discourse relating to reasoning, as 
found in Benedict Ashley's The Arts of Learning and Communi- 
cation (^) . 

c. The complexity of the thought processes in reading, as de- 
scribed in Mortimer Adler's How to Read a Book^^) . 
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d. A study of the thought processes of induction and deduction. 

e. An introductory study of semantics. (See A-4, p.l7.) The 
contributions of semantics to critical thi. iag as explained by 
F. A. Philbrick in Understanding English. An Introduction to 
Se mantics (a book now out of print) (13) , 

f. Techniques of teaching the anatomy of criticism in terms of; 

^nATINGS (opinions, preferences, acceptances, rejections) 
y ^-^SONS (statements expressing reasons) 

(to support reasons: criteria or standards 

of judgments, generalizations; reasons for 
the reasons; product of agreement among 
people) . 

g. Fallacies in thinking and propaganda techniques as viola- 
tions of suspended judgment, criticalness and intellectual 
honesty, accuracy, and tru€ relationship. 

h. A study of advertising in terms of critical thinking. 

Guest speaker; Mr. John Crawford. 

i. An invitation to read a number of references, notably: 
Productive Thinking in Education ^^^) , Reflective Thinking; The 
Method of Education (^2) ^ The A^s of Learning and Communication 
^5)^ Education for Effective Thinking (7), and current issues of 
Elementary English and the English Journal . 

6. Application of Learning and Productive Thinking to the Classroom. 

a. An examination of teachers* manuals to detemnine emphases 
on the higher mental processes. 

b. Individual teachers' compilations of exercises and activi- 
ties involving the skills identified in the study to be used 
with pupils immediately. 

c. Producing lesson plans and units which emphasize intel- 
lectual operations, especially those of productive thinking. 

d. lutervisitaticn of teachers for observation purposes; 
discussion with the help of an observation report form devised 
for this study. (See A-5, p.l8.) 

e. Visitation and evaluation of classes by two supervisors 
interested in the topic of this study as might be indicated by 
their theses' topics: 

Sister Mary Relinette: Study of the Effects of Creative 

Writing of Vocabulary Development 
i n Eightli Graders 
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Sister Mary Vidanta: An Experiment in the Development 

of Critical Thinking Skills in 
Reading, Grades 7~8 

C. Study Days 

Sharing of ideas and demonstrating teaching procedures that aimed for 
critical and creative thinking through workshops held on August 22 
and 24, 1966, under the leadership of the two supervisors and the 
investigator. 



III. RSSULTS 



A. Test Results 

This study tested the hypothesis that in-service training of experienced 
teachers emphasizing the need and procedures for developing pupils* 
abilities to think can improve their ability to think critically. Two 
procedures were used to measure the effectiveness of this experimental 
variable. The first was a statistical analysis of the results of two 
tests, summarized in the following table: 



* % 

! i 

j Statistic 1 


1 Watson-Glaser 
j pre- post- 


! 

Dressel-Mayhew 
pre- post- 


N 


39 


39 


36 


36 


Mean 


60.72 


66.38 


46.08 


49»78 


Standard 

Deviation 

t 


12.16 


11.81 


11.55 


15.20 


i Gain (pre/post) 

1 


5.66# 


1 3.70# 

j 



//nonsignificant . 

Form YM of the WATSON-GLASER CRITICAL THINKING APPRAISAL was used as 
a pre-test “ form ZM was used as a post-test. In the subsequent 
statistical analysis of the WATSON-GLASER each score was transformed 
to an equivalent Form AM score for comparability in assessing gains 
over the semester as suggested in the test manual. The gain of 5.66 
points amounted to less than 1/2 standard deviation. The t value was 
0.434 (df=38) which is not significant at the .05 level. This improve- 
ment was equivalent to 15 points on a percentile scale based upon 
norms for College Senior Women. The gain of 3.70 in the DRESSEL-MAYHEW 
TEST was similarly positive but nonsignificant. 
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B. 



Questionnaire Results 



At the end of the course the teachers were invited to answer a ques~ 
tionnaire. (See A—6, p.l9.) Ninety percent of the teachers responded. 
What these teachers did in answering this questionnaire was to give a 
critical evaluation of their professional preparation for teaching for 
thinking. They mpde complaints about "knowing so little on the subject/' 
about being "inadequately prepared in the area of critical thinking," 
about not having such training "in the early years of college work." 

They emphatically expressed the desirability of scheduling this training 
prior to actual teaching. 

The questions in the course evaluation were general in nature to en- 
courage expression of opinion. It x^ras possible for students to make 
statements about a given point in more than one place. Even though 
tabulating became a problem because of the nature of the questions, the 
amount of information received compensated for this difficulty. 

Ten comments had reference to the course as being a, good review of 
professional education making, them "more sure of themselves," helping 
them "to feel a deeper love of their work" and to learn "more about 
themselves as teachers." 

Fifty-six comments related to the nature of the course, referring to 
it as being challenging, beneficial, and Informative. The emphasis on 
teaching for thinking gave them an Insight into this "new dimension" 
which has practical implications for their classrooms. 

Over 100 comments referred to the method in which this course was pre- 
sented reflecting favorably on such aspects of the course as the varied 
instructional methods used. Forty-two comments referred to the desir- 
ability of the use of audio-visual material, and the profuse use of the 
chalkboard, especially through the use of diagrams, to clarify explana- 
tions. Twenty-four students made favorable comments about the contri- 
butions of the guest lecturers. Over 50 comments were made about the 
informal yet constructive, enthusiastic, but nonpressured nature of the 
classes. Most of the 51 unfavorable comments referred to the lack of 
time to study the subject in depth and to the desirability of more 
demonstrations, more active student participation, and more analyses 
of test results. Four students complained about the amount of testing. 



IV. DISCUSSION 

A study of the comments on the anonyraous questionnaire reveals that 
these teachers x^ere sincerely grateful for this exposure to the topic 
of teaching for critical thinking, that they regretted the fact that 
such training had not been offered them through their professional 
training much earlier in their careers, and that the presentation of 
materials stimulated an awareness and interest in contemporary trends 
in the field of education especially with regard to the topic of 
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intellectual operations including critical thinking. They made favorable 
comments about the informal and diversified nature of the course. Many 
regretted the lact of time for a more thorough study of the topic. 

The desires for increased opportunities for sharing of ideas to which 
the evaluations referred were, in some measure, satisfied through two 
workshops held three months after the course was completed. These were 
devoted to the topics of critical and creative writing. The teachers 
who, during the school year successfully present demonstrations in helping 
students to think, were invited to present a summary of their work to the 
50 teachers in each of the three sessions of the workshop. The investi- 
gator spoke on the topic of "An Analysis of Critical and Creative 
Thinking." 

The complaints about using valuable class time for the purpose of testing 
without analyzing the test results were understandable since the teachers 
were not aware of the fact that they were subjects of an experimental 
study. Action different from that described would have been impossible 
without invalidating test results. 

Some other factors that must be taken into consideration are the diffi- 
culty of measuring Intellection and of finding tests that are truly 
valid. The comprehensiveness of the course, with its emphasis on the 
philosophy and psychology of learning and thinking did not permit a 
detailed study of all phases. Perhaps if more time were devoted to the 
direct study of the skills identified in the tests, significant test 
results might have been obtained. The fact that this course was offered 
to full-time teachers during after-school sessions did not create optimum 
conditions. 

Added insight is gained when the modest gains of this group are inter- 
preted in light of two other studies conducted by this Investigator (8) . 
Seniors in high school English made a gain of 2.4 points in the WATSON- 
GLASER CRITICAL THINKING APPRAISAL after a year’s work; prospective high 
school English teachers in a three semester hour methods course gained 
3.59 points; these experienced teachers gained 5.67 points. Their per- 
formance on the DRESSEL-MAYHEI^ TEST was likewise superior. However, the 
fact that their initial performance was inferior to the students in the 
methods course suggests that they had more possibility of improving 
themselves and, as a result, greater gains might be expected. Similar 
observations were made by other investigators mentioned previously. 

The validity and/or reliability of the two forms of the 1952 edition of 
the WATSON-GLASER for the high school study was questioned because of 
the negative results of the control group and because of the slight 
gains of the experimental group in the WATSvJN-GLASER compared with the 
statistically significant gains made in the DRESSEL-MYHEW . 
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V. CONCLUSIONS, IMPLICATIONS, RECOltlENDATIONS 

The test results as well as the responses of the teachers to a question- 
naire inviting them to evaluate the course stressing the philosophy, 
psychology and methodology of teaching for critical thinking, suggest 
that teachers desire and need knowledge about the operations of the mind 
and training in teaching for critical thinking. Their reactions pointed 
to the fact that such in-service training can be interesting and chal- 
lenging. Their comments corroborated those of educators in general, 
namely, that the area of critical thinking is a worthy objective of the 
elementary and secondary curriculum and, therefore, should receive atten- 
tion in a teacher-training program. 



VI. SUiiMARY 

The Education Department of Loyola University provided an in-service 
training course for 42 elementary and secondary school . teachers during 
the second semester of 1965-66 and conducted this study which tested 
the hypothesis that such a course can improve teachers* abilities to 
think critically. J. P. Guilford’s model of the structure of the Intellect 
was used in studying the contents, the products, and the operations of 
the mind and in planning diversified instruction accordingly. 

The experiment was designed to put into practice the theory that crit- 
ical thinking demands abilities that are varied, specific, separable, 
aid measurable. The characteristic feature of the experimental factor 
was alerting teachers to the importance and necessity of teaching for 
thinking, informing them about the various operations of the human 
mind, and studying the possibilities of applying such information to 
classroom situations. The experimental method was a distinct revolt 
against mere routine learning, memorization, and regurgitation; it 
stimulated teaching that would rise above the routine of merely having 
students acquire facts to the level of independent, constructive think- 
ing and an understanding of the broader values and skills inherent in 
learning and thinking critically. It aimed to familiarize teachers 
with the fact that numerous opportunities can be used to develop the 
ability to think reflectively in a wide variety of appropriate situa- 
tions in a classroom. Various learning activities can be based on the 
assumption that thinking is a process, not a result — a means not an 
end; that a stimulating school atmosphere is a necessary common factor 
for the various skills to be developed; that the skills of thinking must 
be the immediate objective x^hich the teacher keeps in mind continuously. 

The possibility of setting up critical thinking as an integrating 
principle of instruction was considered. 

The criteria for measuring the outcomes of the course were the revised 
edition of the WATSON-GLASER CRITICAL THINKING APPRAISAL and an adapta- 
tion of the DRESSEL-MAYHEW TEST. Positive but statistically nonsignifi- 
cant gains were made in both tests. Even these modest gains and the 
teachers* responses to a questionnaire suggest that the area of critical 
thinking and its application to an elementary and secondary curriculum is 
desirable, interesting, and challenging. 
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A-5 
BSERVATION 



EPORT 



^ ? O' 






Teacher 



Date 




KINKING 



EACHING 

ESTING 



An analysis of a lesson to evaluate elements that 
might contribute to a realization of: 



It 



••• democracy at its best demands of its citizens’^ 
ability to think clearly ^ to attack problems intelli- 
gently, and to exercise critical judgments.” 

Commission on the English Curriculum of the National 
Council of Teachers of English, The Language Arts, p.^5 



RATING SCALE 

F - Favorable - conducive ! N 
to promoting thinking | 

* 

t 1 

THE CLASSROOM 

Physical arrangement 

Cleanliness 



Neutral - does not ; U - Unfavorable j 
apply or ”no I against pro- 1 
comment" | ducti ve think ing | 



Materials __ 
Ventilation 



THE TEACHER 

Poise ; 

Art of Questioning 

THE STUDENT 

Responses 

Learning 

Attitudes ______ 

Behavior 

COMMENTS; 



■-Ev aluat ion' 
X 'Diveygej^t thinking 
Convergent” Thinking 



Memory 



/ Cognition 

— 

L _SPE^ING_ 

LISTENING 



READING 



WRITING 



ACTING 






Signed 
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A-6 

COURSE EVALUATION 

Course Number Date 

Your candid evaluation or this course may help in builciins a 
better curriculum for future classes. You need not sign this 
paper if you do not care to. 

1. Did this course meet with your expectations? Did it exceed them? How? 



2. Identify special areas, features, techniques, etc. that were valuable. 



3. Identify special areas, features, techniques, etc. that were less 
valuable, superfluous, neglected. 



4. Have you any suggestions for improving the course? 



5, please feel free to make further criticism, either positive or 
negative. 
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